Orbital analogue of quantum anomalous Hall effect in p-band systems 
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We investigate the topological insulating states of the p-band systems in optical lattices induced 
by the onsite orbital angular momentum polarization, which exhibit gapless edge modes in the 
absence of Landau levels. This effect arises from the energy level splitting between the onsite 
Px + ipy and px — ipy orbitals by rotating each optical lattice site around its own center. At large 
rotation angular velocities, this model naturally reduces to two copies of Haldane's quantum Hall 
model without Landau levels. The distribution of Berry curvature in the momentum space and the 
quantized Chern numbers are calculated. The experimental realization is also discussed. 

PACS numbers: 03.75.Ss, 05.50.+q, 73.43.-f, 73.43.Nq 



The integer quantum Hall (QH) effect has generate 
tremendous research interests for several decades. The 
precise quantization of the Hall conductance is due to 
the topologically non-trivial band structure characterized 
by the Thouless-Kohmoto-Niglitingale-den Nijs (TKNN) 
number, or the Chern number [l|, 0] ■ The origin of the QH 
effect has also deep connections to the parity anomaly of 
2D Dirac fermions [3, 0, Si- Although breaking time- 
reversal (TR) symmetry is required. Landau levels (LL) 
are not necessary for the QH effect. For example, Hal- 
dane Q constructed a QH model with average zero flux 
per unit cell but with complex-valued hopping integrals. 
Recently, QH insulators have been generalized to the 
topological quantum spin Hall (QSH) insulators which 
keep time-reversal (TR) symmetry and are characterized 
by a Z2 topological number [1, 0, S, i, E, El, El • Ex- 
citingly, experimental evidence for the QSH insulating 
states has been found jl^, . 

Anomalous Hall (AH) effect describes the dependence 
of the Hall current on the spin magnetization not the ex- 
ternal magnetic field, whose mechanism has been debated 
for a long time, including the anomalous velocity from the 
interband matrix element [l5| . screw scattering [l6|. and 
side jump [l3|. Recently, a new perspective on the AH 
effect has been developed from the topological Berry cur- 
vature of the band structure which is a combined effect 
from spin-orbit coupling and spin polarization (isl . [l9| . 
Its quantum version, topological insulators arising from 
spin magnetization has been pro posed and investigated 
in semiconductor systems [ic " 



2l|,l22| 



The current development of cold atom physics has pro- 
vided another new opportunity to investigate the QH 
effect. Several methods have been proposed including 
globally rotating the trap or optical lattice, or introduc- 
ing effective gauge potential generated by laser beams 



27|. However, the rotating angular ve- 



locity cannot be large enough otherwise the centrifugal 
potential will throw atoms away. It is also difficult to 
make the light induced gauge potential strong in a large 
region. 

In this article, we propose an orbital analogue of the 
quantum anomalous Hall (QAH) effect in solid state sys- 



tems, i.e., the QAH effect arising from orbital angu- 
lar momentum polarization without LLs. This can be 
achieved by rotating each optical site around its own 
center which is an experimentally feasible technique [28| . 
The lift of the degeneracy between px ± ipy orbitals gives 
rise to non-trivial topological band structures, and pro- 
vides a natural way to realize Haldane's model. Increas- 
ing rotation angular velocity induces topological phase 
transition by changing the Chern number of the band 
structure. We also consider the QH effect arising with 
LLs in such systems. 

The experiment to rotate each site in the lattice around 
its own site center has been performed by Gemelke et al. 
[iit . Electro-optic phase modulators are appHed to the 
laser beams forming the lattice, which results in a period- 
ical overall translation of the lattice at a radio-frequency 
LUnF but without the internal lattice distortions, ojrf is 
hundreds of times larger than the harmonic frequency lol 
of each site, thus atoms only feel an averaged potential 
with a small distortion along the oscillation axis. This 
axis can be controlled to rotate at an audio frequency 
flz, which induces the rotation of each site around its 
own center at such a frequency. Qz can be much larger 
than the overall parabolic trapping frequency and reach 
a few kilo-Hertz. This technique has been applied in the 
triangular lattice described in Ref. ■ 

Let us consider to apply this technique to the honey- 
comb lattice which has been constructed quite some ago 
m. We study the iP..„.,/-orbital band filled with spinless 



fermions described in Ref. 
gredient of rotation as 
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with the new in- 



^ t\\ X! {pl,iPf+ae,,i + h.C.} ~ fi^UfT, 

r^A r 

Hl = i^z^{pl,xPr,y~pl^yPr,x}, (1) 



where 61.2 = ±-^e. 



-ey are the unit vec- 



2 i \e-y and 63 
tors pointing from a site in the A-sublattice to its three 
neighbors in the B-sublattice; pi = {pxfix +Py(iy) • Ci {i — 
1^3) are the projections of the p-orbitals along the 
Si direction; /i is the chemical potential; a is the near- 
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est neighbor bond length. Since there is no the overall 
lattice rotation, the vector potential due to the Corio- 
lis force and the centrifugal potential across the entire 
lattices do not appear. The effect is to break the degen- 
eracy between p^^ipy as described by Hl. flz can easily 
reach the order of the recoil energy En, and can be 
tuned one order smaller than |3l| . thus we have a 
large flexibility of tuning O^/ty. 

The band structure of Eq. [1] is presented as follows. 
Under the chiral transformation P, i.e., PrA,x,y PrA,x,y, 
PrB,x,y — > —Pi-B-x.y, Combined by the time-reversal 
transformation T, Eq. [1] transforms as {TP)~^{Ho + 
Hl){TP) — ~{Ho + Hl), thus its spectra are symmet- 
ric respect to the zero energy. At $7^ = it exhibits 
two dispersive bands touching at Dirac cones located at 
isTi 2 = (±-^,0) and other two flat bands The 



dispersive bands touch the flat bands at the Brillouin 
zone (BZ) center Kq = (0, 0). We define the 4-component 
spinor as ip{k) = {pAx{k),pAy{k),pBx{k),PBy{k))'^ , and 
the two bases for the dispersive bands as (j)i{k) = 
-\fi2{k), ^(/23(fc) -/3i(fc)), 0, O}, and Uk) - 
^{O, 0, f^^ik), ^(/2*3(^) - /3i(fc))}, where = 



2_ 

No 

2_ 

No 



^''^^ and No{k) is the normalization factor. At 
gaps open between different bands as de- 



nonzero f2 

picted in Fig. [T] A, B, and C. If flz is small, the effective 
Hamiltonian close to the Dirac points of Ki,2 can be writ- 
ten in the bases of (f>i , 4)2 as 



80. 



Hi{k) = 



■ J2i sinfc • bi 



V3No{k) 
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— sin k ■ bi 



where bi = ^iijk{sj — e^) are the vectors connecting the 
next nearest neighbors. The Dirac cones become gapped 
with A = SI2 and the masses are of the opposite sign at 
Ki 2- The bottom band is no longer flat at nonzero Qz. 
Its minimum at Kq is pushed down by a value of ^fl^ 
and that of the second band is pushed up by §^z- This 
opens a gap of 3Qz ■ A similar analysis applies to the top 
and the third bands. 

As flz approaches , the middle two bands at Kq are 
pushed to zero from both up and below respectively, and 
form a single gapless Dirac cone in the BZ as depicted 
in Fig. [1] B. Let us define another two bases as (f)'i — 
^{1, 1, — 1, — i}, and (j)2 — ^{1,— i} for the Dirac 
cone at Kq, and the Hamiltonian matrix becomes 



H2{k) - 



2^11 ^kx 



t\\ikx 4 



til 



(2) 



We notice that a single Dirac cone of the chiral fcrmion 
is allowed in the 2D bulk lattice systems, which actu- 
ally does not contradict to the fcrmion doubling theory 
proved for 3D lattices [13] ■ 

As flz goes even larger, the lower and upper two pairs 
of bands are projected into the single orbital bands of 




FIG. 1: The band structure of Eq. [T] at f7z > as shown 
in A, B and C. Only the lower two bands are presented, and 
the upper two are symmetric respect to the zero energy. A) 
r2z/t|l = 0.3; B) r^z/ty — 1.5 where a single gapless Dirac cone 
appears; C) Qz/t\\ = 3 where two massive Dirac cones appear 
at Ki^2 between the lower two bands and also between the 
upper two bands; D) The pattern of the induced next nearest 
neighbor hopping (complex-valued) at flz ^ fy, which is gen- 
erated by the virtual hopping between orbitals with opposite 
chirality. 



Px ± ipy respectively. The lower two are described by the 
Px + iPy orbital with a nearest neighbor hopping of 
Furthermore, a Haldane type next nearest neighbor hop- 
ping is generated as depicted in Fig. [1]D: one particle at 
site A in the p^ + ipy orbital hops to the high energy or- 
bital of — ipy at its nearest neighbor B, and hops back 
into the p^ + ipy state at the next nearest neighbor site 
A' . Along the directions indicted by arrows, this hopping 
amplitude can be calculated from the second order per- 



turbation theory as tr. 



ty{2^z 



)e'3' 



As pointed out 



in Ref. [5;], this generates two massive Dirac cones with 
gap A = ^tnn at Ki^2 of masses with opposite signs. 

The above band structures exhibit non-trivial topo- 
logical properties. The Berry curvature Fxy(k), or the 
gauge field strength, in the momentum space for the 
n-th band (n = 1 ~ 4) is defined as Fn^xy{k) = 
dk^An^y{k) ~ dkyAn,x[k), where An,i{i = x,y) is gauge 

potential defined as ^„_i = IV'n(^)) The 

eigenstates of the lower two bands are related to those 
of the upper two by the transformation |'(/'4_„(— /c)) = 
{TP)\tljn{k)){n = 1, 2), thus the Berry curvature satisfies 
Fi-n,xy{—k) = —Fn^xy{k). The field strength Fxy of the 
lower two band is depicted in Fig. [5] at different angular 
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FIG. 2: The distribution of Berry curvature F^yik) in the 
BriUouin zone for the lower two bands at different Q.^. A, C 
and E (B, D, and F) are Fxy{k) of the first (second) band at 
^z/^w = 0.3 and 1.7, respectively. The Chern number of the 
first band is 1, and that of the second band changes from 
to -1 at Q.-Jt\\ = |. 

velocities. Fn^xy mainly distributes at wavectors k with 
small gap values of \En±i{k) ~ En{k)\. The total flux in 
the BZ for each band is quantized known as the Chern 
number Cn = J (Pk Fn^xy{k) P, 0. At all values of 
i7z > 0, the Chern number of band 1 is quantized to 1, 
in spite of a significant change of distribution of F^y as 
increasing Q,z as depicted in Fig. [2]A, C and E. The max- 
imal of Fxy are distributed among a ring around the BZ 
center at small values of fiz, and are pushed to the two 
vertexes K12 of BZ as Vl^ increases. The Chern num- 
ber of band 2 is more subtle. At small Vl^, each of two 
massive Dirac points at Ki^2 approximately contribute a 
flux of i. As I from below, the maximum of 

Fxy is shifted to the new Dirac point at the BZ center, 
which approximately contributes the flux of ^. However, 
these contributions are canceled by the background neg- 
ative flux at ilz/t\\ < |, and thus the Chern number 
is 0. A topological quantum phase transition occurs at 
f2z/t|| > I beyond which the flux from the Dirac point 
Ko flips the sign to — i. Combined with the background 
contribution, the Chern number of C'2 changes to —1. In 
analogy to electron systems, the transverse conductivity 
can be deflned as the ration between the mass flow and 
the potential gradient as axy — —Jx/dyV. When the 
Fermi level lies in the band gap, axy is quantized as the 
sum of the Chern numbers of the occupied bands. 

The above band structure with non-vanishing Chern 
numbers gives rise to topological stable gapless edge 
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FIG. 3: The gapless edge excitations with the open boundary 
condition along the zig-zag edge of the hexagon lattice. A) 
^z/t\\ = 0.3; B) r2z/f|| — 1.7. A topological phase transition 
occurs at riz/ty = | above which the edge modes between the 
middle two bands disappear. 

modes lying inside the band gap. Fig. [3] depicts the 
spectra with the open boundary condition on the zig-zag 
edges. The number of chiral edge modes inside the gap 
between n and n + 1 band is the sum of Chern numbers 
from band 1 to n, i.e., X]i=in^n- At Viz < |^||, the 
Chern numbers reads Ci = —C4 = — 1 and C2 — — C3 — 
0, thus edge modes exist in all of the three band gaps 
with the same chirality. At Qz > f ^ j| , C2 and C3 change 
to C2 = — C3 = — 1. Thus the edge modes between band 

1 and 2, and that between band 3 and 4 are of the op- 
posite chiralities. No edge mode appears between band 

2 and 3. This agrees with the picture that Eq. [T] reduces 
to two copies of Haldane's model at flz ^ t|| . 

We also study the QH effect on Eq. [1] arising from 
Landau levels (LL) by replacing the hopping part to 

Hfiop = t\\ ^ {pl^iPf+aei,ie-^'-+'"'i + /i.e.}, (3) 

where the vector potential- yl can be generated through 
another overall lattice rotation or by light induced gauge 
potential. We will take the flux per plaquette $ and ilz 
as two independent variables. The spectra of the above 
Hamiltonian does not depend on the gauge choice but the 
physical wavefunctions differ by a gauge transformation. 
For the calculation convenience, we use the Landau gauge 
for an open boundary system along the zig-zag edge and 
take <I>/(27r) = 0.05. 

Due to the vector potential A, {TP){Hhop + 
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FIG. 4: Edge and bulk states spectra of Eq. |3]with the open 
boundary condition along the zig-zag edge. The flux per pla- 
quette <;/>/(27r) = f/20. A) Q.^m = 0.2; 'a)Q.^m = 1.5. 

Hl){TP)~^ ^ —{Hhop + Hl), thus the spectra are no 
longer symmetric respect to the zero energy. Generally 
speaking, all of the four bands split into a number of flat 
LLs with dispersive edge modes lie in between. The pat- 
tern of edge modes does not change much as varying the 
value of but significantly changes as increasing fi^. At 
small values of (e.g., flz = 0.2t|| as shown in Fig. IH 
A ), gapless edge modes go through the entire spectra 
from the very band bottom to top. Landau levels close 
to the zero energy arise from Dirac cones at Ki^2 with 
opposite masses as shown in Eq. [2l The 0th LL is pushed 
to negative energy at the gap value around — 0.26i||. The 
number of chiral edge modes between levels of n = to 
±1 is 1 with opposite chirality and that between n — ±1 
and ±2 is 3. The energies of n = ±1 and n — ±2 appear 
roughly symmetric to zero energy. Next let us look at 
Hz = where a single gapless Dirac cone appears as 
shown in Eq. [21 Indeed the 0th LL appear close to the 
zero energy but with a small deviation, which is under- 
standable as no exact symmetry to protect it right at the 
zero energy. It is tempting to think the appearance of 
the half-integer QH effect, but this is impossible in free 
lattice fermion systems [H] ■ Another half has to be con- 
tributed from the high energy part of the band structure. 
As a result, the number of chiral edge modes between LLs 
n = and 1 is ^ -|- ^ = 1, while that between LLs n = 



and —1 is —^-1-^ = 0. Thus the spectra from bottom to 
top become disconnected without edge modes connecting 
them. This disconnection actually begins to appear even 
earlier at = 1.2t||, and is enhanced as fi^ goes larger. 
At large values of O^, the model reduces to two copies 
{px ± ipy) of Haldane's model. The patterns of LLs be- 
tween band 1 and 2, and between band 3 and 4 become 
the those of the two massive Dirac cones with opposite 
mass signs. When Fermi level lies in between LLs, the 
transverse conductance axy is quantized at the number 
of chiral edge modes. 

In summary, we propose to investigate the topological 
insulating states in the p-orbital systems in the honey- 
comb lattice, which can be realized by the current avail- 
able experimental techniques. The orbital angular mo- 
mentum polarization generates non-trivial Chern num- 
bers in the band structure, which gives rise to the orbital 
counterpart of QAH effect without LLs. QH effect arising 
for LLs are also investigated, which shows quantitative 
different features from those in graphene. 
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